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© High-speed image rendering method using look-ahead images. 

© A look-ahead image is employed during ray trac- 
ing of the image rendering process to eliminate the 
processing of pixels which are of no interest within a 
given boundary of the ray. During rendering, ray 
tracing is carried out by jumping over the pixels of 
no interest to thereby enhance the rendering speed. 
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HIGH-SPEED IMAGE RENDERING METHOD USING LOOK-AHEAD IMAGES 



TECHNICAL FIELD OF THE INVENTION 

The present invention relates in genera! to im- 
age processing methods and apparatus, and more 
particularly to image rendering techniques for pro- 
cessing image data to create images from new 
perspectives. 

BACKGROUND OF THE INVENTION 

High-speed image processing equipment has 
made possible the processing of image data to 
present new scenes or perspectives of an object, 
from image data of a different scene or perspec- 
tive For example, digital elevation information of a 
geographical region can be processed to generate 
a variety of different two and one-half dimensional 
representations of the-terrain. The new perspective 
scenes of the terrain can be generated by render- 
ing techniques to give the observer a perspective 
view of the terrain from any point m space. From a 
series of such perspective views of the subject 
terrain, a person can experience a hypothetical 
flight over the terrain, without actually experiencing 
a true flight, it can be appreciated that such a 
rendering technique is highly advantageous in mili- 
tary and aeronautical applications. 

Image data related to three-dimensional objects 
may also be rendered to further define, clarify, 
create, etc.. new images which in reality are dif- 
ficult or impossible to observe. Such applications 
include physiological cat-scans. X-rays, sonograms, 
nuclear magnetic resonance, etc. Given such three- 
dimensional image data, perspective views can be 
generated using translucency. opacity or color pa- 
rameters to create new perspective views to accen- 
tuate body tissues or other material. 

Image rendering can be achieved by various 
techniques, including image ray tracing. Ray trac- 
ing techniques are disclosed in connection with 
volume rendering in the technical article entitled. 
"Display of Surfaces From Volume Data", by Marc 
Levoy. IEEE. May. 1988. According to such tech- 
niques, and other similar ray tracing techniques, an 
eye point ts established in free space, from which 
hypothetical rays are extended toward a reflective 
image of the object. In two and one-half dimen- 
sional ray tracing, the image processor proceeds in 
successive increments along each ray to determine 
if the surface of the object has been penetrated. 
Each ray increment or section corresponds to pixel 
location associated with the reflective image. When 
the surface of the image is penetrated by a particu- 
lar ray section, the pixel information, or resampled 
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information thereof, is stored for later presentation 
of the new perspective view. 

According to three-dimensional image ray trac- 
ing, each ray is also incrementally traversed, noting 
5 whether any point of interest is within a specified 
volumetric vicinity. Regions of interest may include 
arbitrary intensity ranges or opacity ranges existing 
within a given sphere in which the ray section is 
centered. 

jo One shortcoming of conventional image ray 

tracing is the time consumed in performing the 
rendering operation. The increments by which each 
ray is traced are generally small. Because informa- 
tion for a large number of pixels must be pro- 

J5 cessed at each point along the ray, the processing 
time of all the rays can become enormous. For 
example, in rendering a typical terrain object in two 
and one-half dimensions, the rendering can take 
ten to fifteen minutes, depending upon the com- 

20 plexity of the base reflective image. Because a 
three-dimensional rendering involves cubic dimen- 
sions, rendering of associated images may take 
even longer. Hence, it can be seen that a need 
exists for an improved technique which reduces the 

35 time to carry out a rendering operation. A further 
need exists for a new rendering operation which is 
faster than current techniques, but which does not 
compromise the quality of the resultant perspective 
view. 

30 

SUMMARY OF THE INVENTION 

In accordance with the present invention, the 

35 disclosed rendering method and associated ap- 
paratus substantially reduces or eliminates the dis- 
advantages and shortcomings associated with the 
prior art techniques. According to the invention, the 
reflective data of the image is preprocessed before 

40 rendering to develop one or more look-ahead im- 
ages which are referenced during the actual ren- 
dering process. Rather than proceed along each 
ray in a traditional single step manner, the method 
and apparatus of the invention determines how far 

45 along the ray one can proceed first by large steps 
and then by smaller steps to encounter pertinent 
image data, without passing or overlooking other 
significant image data. The jumps by which one 
can proceed along each ray without bypassing 

so pertinent image data are determined at any point 
along the ray by referring to the look-ahead image. 
Preferred embodiments are disclosed for both 2.5 
and 3 dimensional rendering. 

Various predefined large jumps are executed to 
determine, in 2.5 dimensional applications, if the 

2 



3 



EP 0 362 123 A2 



4 



surface of the object has been penetrated, if so, 
smaller and smaller jumps are executed so that the 
spatial determination of the object surface can be 
approached without resorting to the conventional 
successive small incremental steps along the ray. 

In a preferred embodiment of the invention, a 
first iook-ahead image is developed by preproces- 
sing the reflective image data to determine, for 
each ray, whether or not a single jump, equal to 
many small increments, can be executed and yet 
not penetrate the object surface. If so. a digital 
notation is stored in the look-ahead image to in- 
dicate that such a large jump can be accomplished 
thereby eliminating the many small individual 
jumps which would otherwise be processed. If a 
single large jump cannot be accomplished without 
penetrating the object surface, then the preproces- 
sing method causes an execution of an intermedi- 
ate jump equal to several small increments. A 
determination is again made to ascertain if the 
image surface is thereby penetrated, if not, a sec- 
ond or intermediate look-ahead image stores there- 
in a predefined notation corresponding to the pixel 
information associated with the ray section which 
penetrated the surface. If the intermediate step 
does penetrate the object surface, then the small- 
est increments are executed, using the elevation 
image data itself to determine exactly in three 
dimensional space where the object's surface ex- 
ists along the ray. In essence, three look-ahead 
images are provided, one being the actual eleva- 
tion image data itself. 

For three-dimensional rendering, large and in- 
termediate jumps along each ray are also carried 
out, using the minimum distance to a particular 
type or quality of pixel. If no pixel of such type or 
quality exists within a sphere centered about the 
start point of a jump along a ray, then the look- 
ahead image data is set to maximum distance 
value. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Further features and advantages will become 
apparent from the following and more particular 
description of the preferred embodiment of the 
invention, as illustrated in the accompanying draw- 
ings in which like reference characters generally 
refer to the same parts or functions throughout the 
views, and in which: 

FIG. 1 illustrates in block diagram form im- 
age processing apparatus adapted for carrying out 
the method of the invention; 

FIG. 2 illustrates image ray tracing employed 
in connection with a 2.5 dimensional elevation im- 
age; 

FIG. 3 illustrates a flow diagram of the major 



steps in carrying out the high-speed rendering op- 
eration of the invention using several fixed distance 
look-ahead images containing worst case elevation 
values in 2.5 dimensional rendering; 

5 FIGS. 4a-4b illustrate image ray tracing em- 

ployed in connection with a three dimensional im- 
age volume; and 

FIG. 5 illustrates a flow diagram of the major 
steps in carrying out the high-speed rendering op- 

io eration of the invention with a single look-ahead 
image containing variable distances to a particular 
type or quality of pixels. 



15 DETAILED DESCRIPTION OF THE INVENTION 

FIG. 1 illustrates image processing equipment 
adapted for carrying out the high-speed rendering 
technique of the invention. Shown is an image 

30 processor 10 for processing image data and pre- 
senting the same on a monitor 12 for viewing by an 
observer. The image processor 10 includes, among 
other circuits, an arithmetic logic unit (ALU) 14 rrr^ 
coupled to an image memory 16. The ALU 14 may vjms? 

25 be of conventional design, or of highly sophisti- -icas 
cated circuits, for processing image data supplied 
to it in the nature of pixel data. The pixel data. -^y- 
whether it be 8-bit or 16-bit words, are stored in the _ - 

image memory 16 and are accessible by the ALU 

30 14. 

In the example depicted by FIG. 1, the image ■ 
memory 16 includes a number of planes 18-24. .-.cr*c 
each for storing a different type of image data. For -::-zzz- 
example, image memory plane 18 may store im- 

35 age data corresponding to a red color intensity, 
while planes 20 and 22 may store respectively 
green and blue image intensity information. An 
overfay plane 24 may be utilized for storing other 
information, such as overlay or look-ahead data, as 

40 set forth in more detail below. Other types of 
memory structures may be employed with equal 
effectiveness to store all the image data necessary 
to carry out the rendering function. A keyboard 26 
is typically associated with the image processor 10 

•15 to control the operations thereof and to provide 
different renderings of an image on the monitor 12. 
A high-speed image processor 10 adapted for op- 
eration according to the invention is described in 
more detail in co-pending U.S. Patent Application 

so entitled. "High Speed Image Processing Comput- 
er", by Pfeiffer et al.. filed September 14, 1987, 
Serial No. 097.664 t the disclosure of which is incor- 
porated herein by reference. 

In order to carry out rendering operations, the 

55 image memory typically is written by the processor 
to store reflective image data. For rendering two 
and one-half dimensional images, the image mem- 
ory 16 stores amplitude or elevation information 
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corresponding to each pixel location associated 
with the image. A destination image is also stored 
m the image memory 16. The pixel data of the 
destination image results from the rendering opera- 
tion and comprises, for example, the perspective 5 
view of the image from the given spatial point 34 
(FIG. 2). The destination image is transferred to the 
monitor 12 by the image processor 10. Specifically 
shown in FIG. 2 is the topography of a geograph- 
ical object 28 which is to be rendered according to w 
the various perspective views desired. Also illus- 
trated are exemplary pixel locations 30 which are 
associated with elevation or amplitude arrows 32 
which depict the elevation of the terrain 28 directly 
above each pixel location 30. Hence, each pixel is 
location 30 stores binary data representative of the 
associated elevation of the geographical feature. 
Typically, image memory 16 comprises rows and 
columns of pixel storage locations 30 forming an 
array (e.g. 512 x 512). 20 

The elevation data stored at each pixel location 
30 can be developed using geographical data of 
the actual terrain, or* by employing different pho- 
tographs of a geographical area and triangulation 
techniques for arriving at the elevation of each 25 
section of the terrain. In any event, it is well known 
in the art the manner in which image data can be 
developed to represent the elevation of a geo- 
graphical terrain which is desired to be the subject 
matter of image processing and rendering. With 30 
such image data information, rendering techniques 
can be employed to create different perspectives 
or views of the terrain 28 by processing the in- 
formation stored at each pixel location 30. Without 
viewing the actual geographical terrain, the render- 35 
ing operation can present to an observer via the 
monitor 12 a perspective view, for example, from 
the spatial point 34, 36 or any other point in the 
image space. As can be appreciated, the perspec- 
tive view from point 34 will be different from that 40 
observed from point 36. Rendering of the image 
data provides the capability for viewing the per- 
spectives of the geographical terrain 28 from the 
vantage points 34 or 36. or any other point in 
space. It is to be understood that while the exam- 45 
pie is described herein m terms of geographical 
terrain, any other image which can be character- 
ized by elevation parameters can be processed 
and rendered accordingly. 

In rendering an image using an image proces- so 
sor 10. a point 34 of particular interest in space is 
chosen as the vantage point. Because the elevation 
characteristics of the new perspective are not 
known with the respect to the chosen vantage point 
34, conventional rendering is carried out by extend- 55 
mg a number of rays, such as 38. from the spatial 
point 34, m an arcuate area from the point 34 to all 
points on the terrain 28. Each ray 38 is convention- 
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ally traversed in an incremental manner along the 
ray segments 40. As each ray segment 40 is 
traversed, the rendering algorithm checks to see 
whether the surface of the terrain 28 has been 
penetrated. In so doing, it is determined whether 
the elevation data stored at selected pixel locations 
corresponds to the spatial point of the ray seg- 
ment. There are generally' as many rays cast from 
the spatial point 34. as there exists pixel locations, 
i.e.. 512 x 512 = 262.144. In addition, the number 
of calculations which must be executed by the 
image processor 10 is equivalent to the number of 
pixel locations times the total number of ray seg- 
ments 40. 

According to an important feature of the inven- 
tion, the necessity for executing image data pro- 
cessing at each ray segment 40 is obviated by 
providing look-ahead images to determine the ex- 
tent by which one can jump over a number of ray 
segments 40 to eliminate the processing thereof, 
while yet not penetrating the surface of the terrain 
28. 

The image data stored in the look-ahead image 
24 comprises elevation information as viewed from 
a desired perspective, such as the spatial point 34. 
Conventional dilation algorithms are available for 
generating the look-ahead data with respect to a 
given spatial point. Essentially, such algorithms 
search for a maximum elevation value in a neigh- 
borhood around a ray segment, and more particu- 
larly seek a worst case elevation within, for exam- 
ple, a fixed radius around a ray segment. In the 
example noted above, a fixed circular radius for 
dilation purposes is not required, but only a pie- 
shaped or arcuate area, since the terrain object 28 
can be viewed entirely from a small angular area in 
which all the rays extend from the spatial point 34 
to any point on the surface of the terrain object 28. 

With reference now to FIG. 3. there is illus- 
trated a flow chart of image processor operations 
for carrying out the high-speed rendering feature of 
the invention. At the outset, it should be clear that 
during the actual rendering operation, various types 
of image data and associated memory areas are 
utilized. For example, in 2,5 dimensional rendering, 
a reflective image is stored in the image memory 
16, which image comprises an array of pixel loca- 
tions storing the gray value intensity information of 
the source image. For color applications, three 
memory areas would be utilized to store red. green 
and blue data of the source image. Also stored in 
the image memory 16 in an array of pixel locations 
is an elevation image. Pixel locations of the eleva- 
tion image have stored therein amplitude informa- 
tion of the source image. The amplitude data 
stored in the elevation image can be dilated ac- 
cording to conventional algorithms to generate data 
which is stored in one or more look-ahead images 
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of the invention. 

In the example set forth below, two new look- 
ahead images are utilized for storing elevation de- 
rived information, a first image corresponding to a 
first jump size along a ray trace, and a second 
look-ahead image for storing like information cor- 
responding to a second smaller jump size along 
the ray trace. Of course, those skilled in the art 
may prefer to utilize other numbers of look-ahead 
images according to the invention. In a preferred 
embodiment of the invention, the elevation image is 
dilated to precalculate, with respect to each ray 
trace, the worst case or highest elevation in a given 
neighborhood. The neighborhood can be arbitrarily 
defined, such as a circle with a radius R, a pie- 
shaped area, or other shape suitable for the par- 
ticular application. 

According to the invention, the first look-ahead 
image is generated having dilated data yielding the 
highest elevation within sixty-four segments of a 
ray trace 38. A second look-ahead image is gen- 
erated having information defining the highest ele- 
vation in sixteen segment steps of each ray trace 
38. The information stored in the reflective image 
area of the image memory 16 can be utilized as a 
look-ahead image defining the highest elevation for 
each segment 40 of each ray trace 38. Hence, 
three effective look-ahead images are provided, 
two being generated by the noted dilate operations. 

In FIG. 3, the rendering operation is com- 
menced at a predefined processor starting point, 
such as shown by reference character 42. As de- 
picted by numerals 44 and 46. the look-ahead 
images are sequentially written with the dilated 
information for use during the rendering operation. 
The spatial point 34 (FIG. 2) is established for ray 
tracing by the interaction between an operator uti- 
lizing the keyboard 26 and the image processor 10 
(FIG. 1). In other words, a spatial point, such as 34 
or 36 (FIG. 2) is selected from which it is desired to 
obtain a perspective view of the terrain 28. This 
programmed operation is shown by reference char- 
acter 48. Once a spatial point for ray tracing is 
selected, an angular direction of the first ray 38 is 
selected, as is a first jump size. This is shown in 
block 50 of the flow diagram. The first ray 38 
selected may be arbitrary, but may be that which 
corresponds to the upper-leftmost ray which will 
strike the terrain 28. The first jump size according 
to the invention is selected as equivalent to sixty- 
four segments 40. That is. jumps in increments of 
64 ray trace segments will be carried out according 
to such program block. 

According to the image processing flow, and as 
noted in block 52. the image processor 10 jumps 
along the selected first ray 38, and particularly to 
the 64th segment thereof. The jump size of 64 ray 
segments was established according to the pro- 



cessing of block 50. With regard to decisional 
block 54, the image processor 10 is programmed 
to check whether or not any segment to the 64th 
ray segment penetrates the object of the terrain 

5 surface 28. This is accomplished by determining 
the vertical height or the Z-axis dimension cor- 
responding to the spatial location of the 64th ray 
section." A mathematical subtraction is carried out 
between the noted 2-axis dimension and the eieva- 

w tion information stored in the pixel location asso- 
ciated with the 64th segment of the noted ray 38. If 
the object surface is not penetrated, control is 
branched back to block 52 where another large 
jump of 64 ray is executed. 

is The processor 10 continues testing every 64th 

ray segment to determined if the object surface 
has been penetrated, and if so. control is branched 
to block 56. Here, the processor 10 tests whether 
or not the current ray 38 tested corresponds ap- 

20 proximately to the same height as the surface, or if 
indeed whether such ray has penetrated the sur- 
face. If the ray has indeed penetrated the surface 
of the object, i.e., does not correspond to the 
surface elevation at that point, the processor 10 

25 continues to block 58. wherein the jump size is 
reduced, and return is made back to block 52. In 
accordance with a preferred embodiment- of the 
invention, the second jump size is established as 
sixteen ray segments. As noted above, the jump 

30 sizes are rather arbitrary, but can be predefined to 
optimize the rendering time according to the par- 
ticular types of object or images being processed. 
As noted by block 58, the processor returns to the 
start of a jump point in which the object surface 

35 was penetrated, and then proceeds sixteen seg- 
ments to conduct tests to determine whether the 
object surface has been penetrated 54. 

In employing the rendering operation using re- 
duced jump sizes, the second look-ahead image is 

40 utilized to determined whether or not a pertinent 
maximum elevation exists anywhere within a de- 
sired neighborhood of the current jump point. 
Again, if the object surface is penetrated during the 
current jump being processed, the jump size is 

45 again reduced, whereupon the processor 10 con- 
ducts the test of block 54 at each pixel located 
corresponding to each ray segment 40. In other 
words, the jump size is reduced to unity, and the 
elevation image is analyzed to determine the eleva- 

so tion data at each ray segment location. 

Eventually, either during the 64, 16 or unity 
jump steps, one ray segment will correspond to the 
surface of the object 28, whereupon the processor 
10 branches to program flow block 60. It can be 

55 appreciated that with the foregoing technique, pro- 
cessing is expedited as it is not necessary to carry 
out the determination of block 54 for each ray 
segment 40. For example, if indeed the 129th ray 
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segment is coincident with the surface of the object 
28. the processor 10 of the invention would ex- 
ecute only four tests according to program flow 
block 54. rather than the traditional 129 process 
calculations. In experiments, it has been found that 
image rendering according to the invention can be 
expedited by a factor of three to five times that of 
prior two and one-half dimensional rendering tech- 
niques Rendering from a typical eye point slightly 
above the surface and directed toward the horizon 
achieves a speed-up of about three to four times 
with the technique of the invention. However, a 
restriction in which the eye points falls within a 45° 
range produces a five to six factor in the speed-up 
of all ray tracing from such eye points. 

With regard to program flow block 60, the 
source or reflective image data is resampled to 
generate new pixel data which will be subsequently 
utilized to present the desired perspective view of 
the image during the rendering process. The re- 
sampling may involve an averaging or interpolation 
of the pixels in the neighborhood of the pixel of 
interest. As noted in program flow block 62. the 
resampled pixel is stored in the destination image 
for presentation on the monitor 12. The actual 
presentation or reading of the destination image 
from the image memory 16 is carried out. as noted 
in block 64. 

The foregoing illustrates the expedited tracing 
of a single ray 38 to determine the spatial location 
of surface of the object to be rendered. Each of the 
other rays is traced in a similar manner until al! 
rays have been processed to redefine the desired 
perspective image of the object. When the last ray 
has been traced, according to program blocks 66 
and 67. the processor 10 proceeds to the exem- 
plary end 68 of the operation. 

The foregoing generali2ed technique can also 
be employed to expedite the rendering of three- 
dimensional objects. As is the case for 2.5 dimen- 
sional tracing, the look-ahead images may be gen- 
erated in one of two formats. 

In the first format, the look-ahead images can 
be generated by testing a volumetric group of 
source image pixels to determine if a pixel of 
interest exists within the chosen volume boundary 
constraints. If a determination in the negative is 
reached, then the volumetric constraints are in- 
creased, and another test is conducted for the 
existence of a pixel of interest. A pixel of interest 
depends on the image parameter to be empha- 
sized, which may commonly be a pixel with a 
specified color range, opacity range, etc. In the 
event a pixel of interest is found within the volu- 
metric image, then the distance to that pixel of 
interest is noted and stored in the look-ahead im- 
age. The distance comprises the number of ray 
segments to jump to arrive at the closest pixel of 
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interest in any direction. 

In the second format, the look-ahead images 
are again generated along a ray within a volumetric 
neighborhood. However, here the tracing occurs at 
5 a set radium, and determines within that distance 
the most extreme pixel encountered. Once this 
distance is determined, it is then recorded into the 
look-ahead image. 

Pixel extremity is a programmable parameter. 
10 such as height in a trace over a terrain source 
image, or other worst case points that may be 
encountered. The magnitude of the radium is set in 
decreasing increments, and matches the distance 
of the jump along the tracing ray. For example, the 
;5 initial span of the radium can be set at 64. Thus, 
from the immediate point along the ray there is a 
jump of 64 units down the ray. and at that point 
there is a spherical span of 64. If no point of 
extremity is encountered, then the magnitude of 64 
20 is recorded into the look-ahead image and the 
tracing will continue. If. however, an extreme point 
is encountered within that span, then the jump and 
radium magnitude is decreased to 16, and the 
jump and span is repeated from the same imme- 
25 diate point along the ray. Again, if an extreme point 
is encountered, the magnitude will be stored but in 
a second look-ahead image. Thereafter, the mag- 
nitude will similarly decrease to 1 and a final span 
and look-ahead image input will occur. 
30 Thus, the location of the most extreme pixel 

encountered within a fixed volumetric span is re- 
corded into the look-ahead image. Therefore, rather 
than a pixel of interest as shown above, the pixel of 
maximum extreme within the defined volume is 
as placed into the look-ahead image. This maximum 
extreme can be used to identify worst case points 
within the dilated volume. 

During rendering of a three dimensional source 
image, the image processor 10 (see FIG. 1 ) again 
40 establishes a spatial point of reference and a num- 
ber of rays to be traced. In a preferred embodi- 
ment of the invention, the look-ahead image is 
configured to store the exact distance to the clos- 
est voxel of interest in any direction so that the 
45 processor 10 can jump directly to the nearest ray 
segment which may be associated with a voxel of 
interest. Such a distance look-ahead image is gen- 
erated by examining successively larger spheres 
around each individual voxel in the original 3D 
so reflective image. The smallest sphere around each 
3D image voxel location which contains an interest- 
ing voxel has its radius placed in the corresponding 
location of the distance look-ahead image. If such 
distance exceeds a set maximum distance, then 
55 the set maximum is placed in the distance look- 
ahead image. Such a distance look-ahead image 
may be re-used during rendering from any per- 
spective viewing position due to symmetry. Re- 

6 




EP 0 



striction of the spherical search above to the 
spherical equivalent of a pie-slice contains the us- 
age of the distance look-ahead image to a certain 
range of viewing positions, but improves perfor- 
mance from those viewing positions. During the 
tracing of each ray. the distance look-ahead image 
is consulted to determine how many ray segments, 
if any. can be skipped, without overlooking any 
voxels of interest. This determines the next point 
further down the ray to again consult the distance 
look-ahead image. When either the look-ahead im- 
age or the resampled voxel data indicates a valid 
reflective voxel, this voxel is processed according 
to a translucent rendering model, opaque rendering 
with illumination, or any such rendering technique 
common in the art today. This process automati- 
cally slows down to single-segment image ray trac- 
ing in neighborhoods of valid voxel data, and 
speeds up automatically as valid voxels are on the 
closeness of the current ray position to the nearest 
voxel of interest. The technique provides all valid 
voxel data to the voxel rendering process, and as 
such, makes no errors during acceleration of 3D 
image ray tracing. An example of three dimensional 
rendering to an interesting voxel is shown in FIG. 
4a-b. A voxel is simply the name given to an image 
pixel in three dimensional analysis, and it is under- 
stood that the term "pixel" hereinafter comprises a 
two dimensional image pixel as well as a three 
dimensional voxel. In FIG. 4a-b, there is shown a 
ray 134 being traced through a source image vol- 
ume 130. Within the source image volume 130 
there are voxels 132 representing the source image 
130. During tracing, there is a determination at 
each ray 134 iteration of whether there is an inter- 
esting voxel by consulting the corresponding loca- 
tion of the distance iook-ahead image 138. When 
an interesting voxel is encountered, all voxels of 
interest are resampled and provided to the render- 
ing process. The iteration continues by examining 
the next ray segment a single step further dawn 
the ray, which is checked for validity as usual. Note 
that as a valid voxel area is approached, the dis- 
tance look-ahead image provides decelerating dis- 
tances 142. As the valid voxel area is penetrated in 
the reflective image 146. the distance look-ahead 
image indicates valid voxel data by zero distances 
140. As the valid voxel area is left, the distance 
look-ahead image provides accelerating distances 
1 44 away from the area. 

Other differences in rendering three dimen- 
sional source images will be apparent to those 
skilled in the art, and with the present disclosure, 
any programming alterations to accommodate 
three dimensional rendering can be readily recog- 
nized and implemented. In FIG. 5 there is shown a 
flow diagram of the major steps in carrying out the 
high-speed rendering operation of the invention 
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with a look-ahead image containing variable dis- 
tances to a particular type or quality of pixels. 
Rendering commences from a predefined process- 
ing starting point 80. Both the rows 82 and col- 

5 umns 84 of the output {i.e. look-ahead) image are 
rendered from an originating spatial point 86 in the 
direction of interest 88. The process proceeds 
along the ray 90 in accordance with the distance 
look-ahead images. Where no pixel of interest ex- 

70 ists 92 the look-ahead image will so reflect and the 
process will continue along the ray 90 until an 
interesting pixel is encountered. Once encountered, 
resampling and partial rendering occurs 94. with 
the next jump size set for a single segment forward 

15 along the ray 110. This process of invalid voxel 
skipping and occasional valid voxel resampling and 
rendering occurs iteratively, until the 3D reflective 
image volume ends or the ray reaches a preset 
maximum extent 112. Note that this process may 

20 occur with image ray tracing back-to-front or front- 
to-back, depending on the rendering process used. 
When all valid voxel data has been resampled and 
rendered along a single ray, the information is 
stored 96 and displayed 98. The entire process 

25 continues until all row rays and column rays have 
been traced. 

From the foregoing, disclosed are apparatus 
and a technique for providing high-speed rendering 
of new images from image data representative of 

jo other images. More particularly, disclosed is a 
technique for preprocessing image data to gen- 
- erate at least one look-ahead image for use in the 
actual rendering operation to eliminate unnecessary 
processing during the ray tracing step, thereby 

35 reducing the time by which the rendering operation 
can be carried out The look-ahead images are 
shown to be of two kinds. In the first case the worst 
case values within a fixed distance for a fixed set 
of viewpoints are stored in each look-ahead image. 

40 The values may be voxel intensities, colors, eleva- 
tions, opacities, gradients, or any arbitrary set of 
values associated with each voxel of the 3D reflec- 
tive image. Multiple look-ahead images here cor- 
respond to different fixed distances for each iook- 

45 ahead image. In the 2.5D terrain example, worst 
case elevations within fixed distances of 64. 16, 
and 1 pixel are stored in the look-ahead images. 
This type of look-ahead image supports a render- 
ing speed 3-4 times faster than conventional image 

so ray tracing. 

In another aspect of the invention, the dis- 
tances to a fixed type or quality of voxel are stored 
in the look-ahead images. The type or quality of 
pixel is as fully general as mentioned above in the 

55 first case. Multiple look-ahead images here cor- 
respond to different fixed types of voxels for each 
look-ahead image. In the 3D volumetric rendering 
example, distances to an arbitrary set of voxels are 
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stored in a single distance look-ahead image for 
rendering. This type of look-ahead image supports 
a rendering speed 20-30 times faster than conven- 
tional image ray tracing. 

Either type of look-ahead image may be refor- 
matted, summarized statistically, estimated, or oth- 
erwise transformed to a desired dimensionality 
without changing the essential nature or purpose of 
this data. The new form of the look-anead data 
might be a 10. 2D, or 30 array indexed by inten- 
sity, color, opacity, gradients. XYZ location, or any 
other index. For example, statistical summarization 
of the distances to white voxels in 3D might show 
that all black voxels in a particular 3D image were 
at least 29 voxel units away from the nearest white 
voxel. Performing this summarization for all grey 
values could produce a distance look-up table with 
a single look-ahead distance for each voxel inten- 
sity. Such an implementation requires less look- 
ahead image memory but sacrifices performance. 
This example supports a rendering speed 3-4 
times faster than conventional image ray tracing. 

With the preprocessing of the image data to 
eliminate unnecessary processing, whether in three 
or two and one-haif dimensional rendering, a re- 
duction of rendering time is realized. In any of the 
apparatus or methods such as the foregoing, many 
changes can be made which are not relevant to the 
novel features taught by the invention. Bearing this 
in mind, the specific embodiments disclosed herein 
are intended to be merely exemplary of the inven- 
tion and not restrictive thereof since various modi- 
fications readily apparent to those familiar with the 
art can be made without departing from the spirit 
and scope of the invention, as claimed below. 



Claims 

1 . Apparatus for providing a high-speed render- 
ing of a new image from image data representative 
of an old image, comprising: 

means for defining a spatial point of perspective so 
that the old image can be rendered and thereby 
produce a new image: 

means for processing the image data by ray trac- 
ing to produce at least one look-ahead image hav- 
ing stored therein pixel data utilized during render- 
ing to increase the speed thereof: and 
means for carrying out said rendering by tracing 
each said ray and referring to said look-ahead 
image to eliminate processing where pixel image 
data of interest does not exist. 

2. The apparatus of Claim 1, further including 
means for preprocessing the image data to pro- 
duce a plurality of look-ahead images, each image 
storing information concerning different sized 
jumps along each said ray. 



3. The apparatus of Claim 1. further including 
means for storing information in said look-ahead 
image concerning highest elevation data associated 
with said old image which is within a predefined 

5 number of pixels. 

4. The apparatus of Claim 1, further including 
means for storing in said look-ahead image in- 
formation concerning a predefined color range 
within a given area. 

jo 5. Apparatus for providing a high-speed render- 

ing of a new image from image data representative 
of an old image, comprising: 
means for defining a spatial reference point: 
means for defining a plurality of segmented rays 

75 emanating from said spatial reference point; 

means for referring to a look-ahead image in trac- 
ing each said ray to determine how many steps 
can be skipped without ignoring pixels of interest; 
and 

20 means for jumping along each said ray during ray 
tracing according to said look-ahead image refer- 
ence to thereby eliminate processing where no 
pixels of interest exist to thereby render said new 
image. 

25 6. Apparatus for providing a high-speed render- 

ing of a new image from image data representative 
of an old image, comprising: 

means for generating a look-ahead image by dilat- 
ing image data to determine the existence of a 

30 pixel of interest within a given boundary; and 

means for rendering said new image by ray tracing 
techniques and by referring to said look-ahead 
image so that pixels of no interest along said ray 
are not processed, thus enhancing the speed of 

35 said rendering. 

7. In an image rendering process in which ray 
tracing is employed to generate a new image from 
an old image, an improved method comprising the 
steps of: 

40 generating before said rendering a look-ahead im- 
age to determine pixels of interest within a given 
boundary area: and 

skipping through said boundary area during said 
ray tracing if no pixel of interest exists to thereby 
45 enhance the speed of said rendering process. 

8. The method of Claim 7, further including 
generating a plurality of said look-ahead images, 
each having a different sized boundary area. 

9. The method of Claim 7. further including 
so rendering said image by first consulting a look- 
ahead image having a large boundary area, and 
secondly consulting said second look-ahead image 
having a smaller boundary area if a pixel of interest 
exists in the first boundary area as defined by said 

55 first look-ahead image. 

10. The method of Claim 7, wherein said pixel 
comprises a voxel. 
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